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ABSTRACT 

CI 

Recent research by Colemn, Hoffer and Kilgore on the effectiveness 
^of public a^nd private schools may be seriously flawed because of its 
neglect of input-level differences in student performance and its reliance 
on cross-sefitional testing data as the criterion measure. Using data from 
the High School and Beyond and the NLS Class of 1972 ^data sets, we examine 
public-Catholic sector differences within high scho|^l tracks for a variety 
of congitive and achievement outcome measures. EvenNX^/ithout any controls 
for sector differences in student characteristics, the public-Catholic 
differences are all very small. They account for less than one percent of 
the variance in both test scotes and in years of school completed. When 
stucjLent selection and background characteristics are controlled, these small 
di^^ferences shrink even further- We thus cannot agree with Coleman, Hoffer 
and Kilgore ^s claim that Catholic schools produce better cognitive outcomes 
than do public schools. This claim is the first of tlie "factual premises" 
that they say would support policies to increase the role of private schools 
in American education. In our view this premise is wrong, and hence should 
no t be invoked in support of such policies, 



iii 



6* 



' ^ ; • Acknowledgments 

We very much appreciate tfae helpful advice or our colleagues Doris 
Enti'/isle and James Fennesgey. 



iv 



ERIC 



7 

4 



I'lUVATK fiCIUKH.S AND VWWAC. I'Ol.lCY: 
NI'.W KVIDl'lNC.K OH (:0(;NrnVK ACHIHVKMKNT IN I'UIU.IC AN!) I'RiVATK SCiiOOl,;! 

liTi'Mi stiulv (!njnnau, llollrr aiul Kll).\nr<» (PUUM)) c'otujnu'i'ii M hr fl I im* t 1 vtMU^Mj: 
ol ::i't*;>nihir V ?ii'hni>lM lA thr inil)l ami private* fU'rtor?i aiut huuul in tavnt' 

ol private {U'lioola. This jilndv \u\ti attrartnl a IntrirfJt ami 

t 

a tt^iMit Ion, hJiiU imu'h ol that on llu» part oT tin^ rrjaMrrh oomnuuiUv brfii^* 
hlj'.lVlv inltlral. Althouj.',h ('oliMiuui and I'o I 1 oav,»Hvi iiavr rrnpnndcMl to muxv oT 
t ho 1 1 1 1' Iv'jup: ilIro\'ltMl at tisoir work, immorc^uis I'ouroniM romala utuoaolvoil 
ami itM'oar.'io io ronvlni'lii^'. ovldtnu'o ha.s^ bvcw i»:u'ot;il tap.Uv raro throu^iioat t ho 
ilolMto. 'I'ho pi'tMiont fstmlv, ioh^ In I'ritloal ot (loliMuan, llollor ami Kllp.oro'n 
it»?aMrrh, hat ralhiM^lhan slmpiv oivjiroiia I uf, oar nvanvat Itur'i, wo ahio aro , 
ahir* to pi o.noti t Hr I 1 t\a I aualy.soM on jjonu* <»! tho lf;ruio?j that *r'oui)lo aa nuifit 

'H\v ovitloiu'o lailfi io aapiuH't^ out* ol (loloiiian, ol at ♦'a ctMitral rlalma • 

»■ 

tiiat pi'lyato sfhoola prfuhiro hot tor rof'.nltlvt* outi'omoN tlian puhl Ir ?u'hoola. 

OhvIiMialv, tlilii la a nuittt»r o\ I'on.a Itlornh 1 1* prarllral ImpiM' t anot* . Imh^'il* 

tloloman, llothM' ami Kll^\oro'j3 I'oaola.slon tha< private fU'i'ttU' fU'htuWN ato 

mort* olli»i'tlvi» than tlu>Mo (u t iio puiilfr aortx^U' la prolMhlv iho rotitral 

t'<v*ailt o\ thoh ^^tluly, at hMat aa JiKlfU'il hy t ho „ roatM Ion it haa i»vi»Uoil. 

In Ifj'hi thLs, It 1:j oaporlally hnpiUtaut that* tho (^vldiaioo In rutppoi t 

iM tiila koy piitnt ho ptTnuaai v<* , Aa will ho appartMit ahorlly, wo 1 inil 

tholr t^vldonro lai^ Mom ronvinr iufv ^vnd wt» lin<l llttlo aupport lor'tht»h' 
\ 

position In onr own^ analya la, 

Thoro la na niMut horo lo r<».';tato c i' i t 1 c l ama alroailv mailo hv othorfi* 
Tin* ooniN'rna that nuujt tronhto aa InvoU^o (lototnaUp llollor and Kii^oroVa 
KJ'l lam^o npiin rr'vaa* aor t lona I data and tiu»Ir luuhlllty io doal aa I I rU ao t ot 1 1 v 



v/ith the issue of selection biases arising from differences in the mix of 

students attending schools in the various sec tors • Probably the single 

greatest burden of school effects research is to distinguish convincingly 

between outcome differences that reflect simply differences in the kinds of 

students who attend various schools from differences that are attributable 

to something about the schools themselves. This is no easy task under the 

best of circumstances, and is especially difficult when students (and parents) 

select themselves into schools on the basis of criteria relevant to the 

outcome being evaluated. Put simply, when good students go to good schools, 

how are we to know which is responsible for the good performance that is 

likely to be observed? 

In the present instance, we know that schools in the public and private 

2 

sectors differ in their educational missions and academic priorities and in 

3 

the mix of students they enroll. The standara way to take account of such 
complications . is to obtain measurements on those factors that are thought to 
be most relevant and to enter them into the analysis as control variables. 
Hence, differential sector effectiveness would show up as mean sector 
differences on the performance criterion after adjustment for sector differ- 
ences in relevant student input characteristics. 

Although Coleman et al. adjust for student differences involving socio- 
economic background and race/ethnicity, they neglect differences in competency 
or achievement levels that predate high school. This is a serious omission, 
one that severely compromises the basic findings of their study. Consider 
the following ppints; 

1, Fori^large populations the overtime stability in levels of 
performance on standardized tests of the sort employed by 
• ' Coleman et al. consistently has been found to be quite substantial, 
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2. Student background characteristics are only partial proxies 
for such competency differences. * 

/ 

•3. Estimates of school effects on standardized test performance 
which neglect pre-existing differences in performance levels 
are likely to be substantially upwardly biased. 
In lignt of thei^e facts, the finding that students in the private 

sector score modestly better on standardized tests than students in the 

Q 

public sector even ,af ter adjusting for'- student socioeconomic* and demographic 
characteristics is equivocal. If, as seems likely, private sector students- 
are somewha t^more capable initially, then' Coleman et al.'s results almostc 
certainly reflect at least partly, and perhaps vholly, these initial 
advantages. 

There is another data set well'-suited to the issues considered by - 

y 

Coleman et al. which would not have been so restrictive as the HSB survey 
tiiey employed. This is the National Longitudinal Study of the High School 
Class of 1972 (NLS) . This project includes both private and public schools, 
it contains information on a great variety of school ou tccmes , and, .perhaps 
most importantly, it now spans a seven year period. With the NLS data, 
a more proper evaluation of the puhl ic-priva te question is possible, and it 
is to the NLS that we no\<r turn for additional evidence on the purported 
superiority of private schools over public. When possible, we also present 
HSB results as a base of comparison. The Jfollowing figures indicate the 
coverage of both students and schools in the two data sets: 
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lU>th filntUi^S provide bn^ad national rovrrafv* ^^sid rlalm i ^niMi tii- 
tiv<Mu»N.s with ifp.anl to \\w\x nvMpin tlvt* (\ohortfu tho p,r*'»^l^'» 
ol t!u* UHH, howt'Vtu , oiliu?) ohviou^J atlvanlaKCS wlu»n to(u«;Itu\ on fiubKtoups 
ol sporlrJ iuton^st -aiul It Ir. botttM- ablo to wlthfJtand thi^ varlmiN :n>ur(*(^H 
i»i Nam])h» at trl t Ion that taU<» i\w\v toll In »m>(U pro jcMMs. Ont^ V(*i v 
proMnlnr, limitation oi tbo NbS In \ U\ small numboi oi prlvati* Min-tor non 
Catholli' •u'hoolfi. Hi^caufJo ol ihl^N wo obono lo limit our attouMon to 
Catholic and ind)l Ir ailumlf, for whhh namplt* covora^'.o \n mon* advipia to . 
ColiMuau, llollor aiul KIlKoro (19H:»a), luw»vor, rtVojitlv havo ai^Unowl (uI|m%1 
that tho fjamt>linr, of non-Ca thol l(^ prlvato sohooln \va;i inadt^inato In tlu* 
IISH Mtudy a?: wtd.l , and mo, a?j a i>rart<ral matt(*f^» both thoir .Mt\idv atul out s 
rdunild moro pn>p(Mly b(» pro?uMitod a,s pnbl (!a tliol lo iMunpar Ifionr; , ratlu»r 

o 

tluin publ l(*-i>r Lvatt^ Vor tblji foous, both data fsMfJ aro (jtilto .sor vliMMbh*. 

Tabli* 1 ])rtvuMiitfi moan iUu^roM on tho s taudai d I ^'.otl Iroiu the* WWW 

aiulon tlu»lr oount(»rpar tn In tho Nl.S, Rofuit tr. an» roporttui for VrrbaU 
Math atul^^ Roadlnj', Subtor.tn ami fur a rompofdlo whh'h Im a- ';Impl> :.nm ot- tho 
oiht»r Jhroo. lU'r.ul ti5 aro proMt*ntod only for nonloiii in tho in»U studv. 1'ho 
Nf.:I, afi' mont lotiod aboV(s fmmi^lod i>nlv tuMilorfi. 

All XvwKw aro ;uMlod aa .standard .soort^s (ovorall sam]>ir mran ot SO; 
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S.D. of 10). Both sets of tests wer^^developed by Che ETS and they do contain 
some identical items (for more detail on the HSB tests, see Heyns and Hil ton, 
1982). Hoxvever, apart. from our having adopted a common metric, -we have made 

V 

no particular effort to equate the tests across studies. In light of this, 
tne parallels bet^^7een tjie HSB and the NLS figures in Table 1 are especially 
striking. , 

Table I About Here 

Comparing public and Catholic means, we find a consistent advantage 

for the latter. Although the differences are not espec ial Iv ' large , they 

all are somewhat greasier in the NLS than in the HSB. For instance, in the 

NLS the mean differences on the subtests aie on the order of four- tenths 

of a st'-indard deviation, vjhlle in tho^HSB they art' closer tcV two-tenths 

of a standard 'deviation. In.both data sets, the disparity is greatest on 

the vocabulary tegt. ' ' 

(■ lliese figures, however, may not be the most appropriate comparisons. 

Schools in the two sectors differ somewhat in their educational goals. 

Because of this, an argument can be made for focusing on differences between 

students who are pursuing similar programs of study. Private sector schools^ 

tend to be more oriented toward preparation for college; hence, in that 

sector cogr^itive skill development should be a more central priority. These 

differences in scholastic orientatifin are reflected in the track enrollments 

In the two sectors. Based on student sel f-repor ts, 3-4 percent of the HSB 

public school students are enroll-ed in the academic track compared to 69 

percent- in fehe Catholic sector. The corresponding figures for the NLS 

6 

are A2 and 67, based on school records. 

Since academically oriented students are presumably more capable on 
the average, the overall figures in Table 1 to some extent likely reflect 



merely these differences in curricular patterns across the t^^o sectors. We 
therefore also consider test sc^re results for academic and general track 
students separately,^ Iflien comparisons betx«7een sectors are made within 
curricula, the original differences j which themselves were rather modest, 
become even slimmer. In fact, in the HSB data they become inconsequential. 
Among non-academic youth, the subtest differences range from just over 
two points on the Vocabulary test to about one and a half points on Reading, 
Among academic students, all of the differences are very small, and two 
actually favoi: public schools. Neither of these public school advantages 

is at all large, but the reversal itself is striking. These, it should 

' - 8 

be recalled, ar^' the same data used by Coleman, 

In the KjLS data, the general track comparisons are not much different 
from the overall figures; for academic students, however, the differences 
are all smaller. Although these latter comparisons still all favor Catholic 
schools, the differences themselves are trivial. For the subtests, the 
largest is but tx-io points and the smallest is under one point. The difference 
betx-jeen <^:he composite means is only about ,15 of a standard deviation. 

Table 1 also presents similar, breakdowns for* the other outcomes which 

tli^ NLS makf^ available. These include SAT scores for those youth in the 

'{'''. 

9 

li'io sectors who took the test, scores on verbal and math tests which were 
administered to a subsample as part of the 1979 follow-up, and data on years 
of scjiool completed as of 1979, seven years beyarid high school. Before 
considering the averages themselves, we should point out that the^ are 
!)ased on widely i> varying sample sizes, This is due to differences in their 
j?oureeS. Students with SAT's are self-selected owing to their having 
t'lected to take the test, while the 1979 tests wer^ adiinistered to only 11% 



'f the original sample. The number of non-academic Catholic schcjol students 



is especially- small for these variables. On the other hand, coverage for 
the years of education measure is much more satisfactory. 

These sparse figures are partially offset by the rarity of such data, 
especially the re-admistration of standardized tests. Additionally, the 
samples of students taking the SAT in the two sectors, being similarly 
oriented toward college, may actually be more comparable than even the 
groups defined by track membership. Hence, this sort of self -selection 
may compensate partially for the initial dissimilarities betii/een the two 
sectors. As a practical matter, moreover, the results turn out to be 
similarly patterned across all outcome measures, suggesting that the 
varying case base is not a critical consideration. 

Despite reservations because of the reduced N's, the NLS figures 
in the lower portion of Table 1 are highly congruent with those for the 
cross-sectional test results. The gross public-private comparisons 
nearly all favor Catholic schools, but in absolute terms the differences 
are quite small. The one exception involves quantitative SAT scores j where 
the averages for the two sectors are very nearly identical. More interesting 
than these gross comparisons^ however, are those within Nominally equivalent 
tracks. Adjusting in this way for differences across the sectors in the 
proportions enrolled in the two tracks has dramatic consequences. Now 
there are, at most, only two differences of any consequence (the Catholic 
sector advantage on the verbal SAT among academic students and the Catholic 
sector advanta'ge on the verbal follow-up test among general track^youth) 5 
and even these are quite small. The other disparities all are trivial , 
and four actually favor public school students (three of these involve 
quan ti ta tive tes ts) , 
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If one accepts the procedures employed in Table 1, then even at this . 
simple descriptive level there is little basis for claiming that private 
sector schools (i.e.. Catholic) produce outcomes superior to public schools. 
However, for both completeness and conclusiveness, \-je turn now to a more 
analytic consideration of these data. These results are presented in Table 
2. HSB analyses again are provided as a base of comparison. 

For each outcome we report the coefficients obtained for a sector 
dummy variable predictor across several regression estimations, with all 
analyses performed separately for academic* and general track students. "^^ 
The estimations differ in the control variables they include. The first 
entry is that obtained 'with no controls. In standard form, this is the 
zero order correlation between the sector dummy and the test at issue. 
This, then, e3<;^fesses the observed difference between Catholic and public 
schools. The second entry is obtained from an equation which adjusts for 
regional ^nd locational (i.e., urbanicity) differences between schools in 
the two sectors; and, the third takes into account differences in the 
personal characteristics of students in the two sectors (i.e., SES back- 
ground, race/ethnicity and gender). Hence, the sector coefficient for 
the third estimation reflects public-Catholic differences among similar 
kinds of students, who attend schools in the same area, who also are in 
the same tracks. Finally, for the long-term outcomes in the NLS, also 
present the results obtained when scores on the 1972 test battery are 
controlled. Since we think the 1972 test results more likely reflect 
student selection differences than sector effectiveness, this last analysis 
adjusts for relevant differences in competency levels between students in 
the two sec tors. "^"^ R-squared statistics for these several equations also 

are' presented. We 'experimented with a great many variations on this 

12 

straightforward way of proceeding; the results presented in Table 2 are, 

15 



we believe, faithful to the implications of these data in all important 
respects, 

^ Table 2 About Here 

The zero-order correlations between our various outcomes and the 
sector variable all are quite small. These appear in the first column of 
results for each curriculum. In not a single instance does the sector 
distinction account for even as^much as one percent of the criterion 

■ - f ' 

variance — and these figures prc|bably ar(> upper-bound estimates of sector 
differences! The largest R is .008, tkis being for the vocabulary subtest 
among NLS general track students. 

It appears, then^ that even at this gross level sector differences 
are not large enough to x^arrant attention. This conclusion certainly 
applies to the HSB data. For academic track students not a single R 
statistic exceeds .001, and three of the four coefficients are negative 
(negative signs indicate public school advantages over Catholic). Among 
general track students, the pattern is a little different because all the 
comparisons favor Catholic schools and the coefficients are a bit larger 
than in the academic track comparisons. However, they all still are 
substantively trivial. 

In Coleman, Hoffer and Kilgore's study too the pub lie -private dis- 
parities tended to be greater for the general track. The researchers 

interpreted this as revealing where the private sector's advantage over / 

/ 

the public was most pronounced. It strikes us as at least curious, though^ 
that private schools most outpace public schools in the curriculum where 
cognitive skill development presumably is less salient. 
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It is possible 9 on the other hand, that these results merely reflect 
the superior initial competencies of Catholic school students. Recall 
that differences in pre-existing testing levels are not taken account of 
in these comparisons. Although the controls introduced in columns 2 and 
3 no doubt ad jus t =par tially for such uifferenceSp we know from other research 
that they do not do so fully. It is likely that such uncontrolled 
variability in initial capabilities will result in upwardly biased estimates 
of sector differences. 

What the data may actually indicate, then, is that the academic track 
in both sectors attracts students of roughly comparable abillties/a^chieve- 
ments, while the Catholic sector tends to enroll somewhat more capable 
students in its general track • The public schools, of course, must admit 
virtually anyone who enrolls, whereas Catholic school admissions are 
selective in at least two respects; fijrst, on the part of the parents and 
students who choose a non-public option; and, second, on the part of the 
schools themselves, which retain the right of refusal. For these reasons, 
it would be quite surprising if Catholic school students were not^ in the 
aggregate, somewhat more competent initially than those in the public 
schools* 

We thus strongly suspect that our analysis, as well as Coleman et 

al.'s, could mistake selection differences for evidence of differential 

13 

spxtor effectiveness. But even if the figures in Table 2 are accepted 

as evidence of effectiveness, the HSB results in column 1 offer little 

reason to think Catholic schools superior to public. The effect of adding 

locational and background controls in the second and third estimations is 

14 

to reduce the already trivial differences even further. 
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The NLS results for cross-sectional test scores ^re highly congruent 

with those from the HSB: general track differences exceed those for the 

academic track, but none is especially pronounced; and, the small zero-order 

differences shrink even further when controls are introduced for locational 

and student background differences between the Wo sectors. Also, as was 

observed in Table 1, the sector disparities generally are somewhat greater 

in the NLS than the HSB, All these differences, however, involve very 

15 

small coefficients. The major message of these data thus seems clear: 
there is little reason to tfiink Catholic schools any more effective than 
public schools in f os tering high levels of cognitive development."^^ 

In light of these results from our replication of Coleman's analysis, 
what we originally thought would be the unique contribution of the present 
study seems somewhat anticlimactic. Nevertheless, the other NLS outcomes 
are of interest in their own. right, and our findings on them are presented 
in the lower portion of Table 2, 

Differences in SAT performance favor the public schools in three 
out of four comparisons even before any controls are introduced, but ng>ne 
of these is statistically significant."^^ General track students in Catholic 
schools score somewhat higher on the verbal test, and this difference is 
statistically significant (in fact, this is the only significant zero order 
association in the NLS data). As locational and background controls are 



entered into the anal3rBis, hox^rever, the one Catholic sector advantage 



Shrinks somex\rhat, while all three public sector advantages tend to enlarge. 
As has been the case throughout, in no instance are these differences at 



Three of the four zero^-order comparisons for the 1979 test scores 
favor Catholic schoolsj but again ngne of these is statistically significant. 



all substantial. 
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,0n the other hand 5, public school academic track stjudents modestly outperform 
their Catholic school counterparts on the math teat. When adjustments are 
made for locational differences betl^7een schools in the tJ/io sectors, public 
students surpass Catholic school students on the math test in both tracks 
(see. the second column of results), and the pattern remains the same when 
adjustments are made for student background differences. 

For these latter outcomes the results for yet a fourth estimation^ 
which controls on students* scores on the 1972, test -battery, also are 
presented. The 1972 *test"data thus are used ^as though they "reflected 
student competencies "thlit existed prior to high school. This no doubt- 
oversts^tes the resistance of such traits to academic influence but it 
probably is more appropriate to use them in this way than it is to use 
them as school outcomes when one cannot also control for their corresponding 
"input" values. The latter, of course, is what Coleman, Hoffer and Kilgore 
have done. i | 

We had' expected that adjusting for test score differences in this way 
would attenuate the sector coefficients obi^ained when only student back- 
ground and school location factors were controlled. And, in fact, these 
test controls do drive down the Catholic school advantage 5 with three of 
four differences at this point favoring the public schbols. Although* there 



clearly is room for disagreement over whether this is aiji appropriate use 
of the Class of 72 testing data, Coleman et al.'s conclusion had been 
found x^7anting veil before we got to this point. Hence, the general import 
of our analysis does not hinge on this particular detail of our procedures. 

The picture is very much the same for our last dependent variable, 
years of school completed as of 1979, seven years beyond high school. 
Among general track students, those attending Catholic schools tend to go 
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very slightly further through school than those from public schools, but 
this difference is eliminated^when adjustments are made for student back- 
ground characteristics. Among students in the academic track, attainment 
levels are virtually identical to begin with. As controls are* added, a small 

■ a 

difference favoring public ' schools emerges, but this never reaches signifi- 
cance. Once again, then, we see little indication that private sector schools 
outperform those in the public sector. This has been consistently the case 
across many ouWome measures and in both data sets. 

In light of this striking consistency, there is little reason to 
think Catholic schools more, ef fee tive than publis schools in promoting high 
levels of school achievement. There no doubt are many considerations which 
incline pmd parents and youth foward private sector schooling, and there 
might well be good reasons to advocate policies which broaden educational 
optioni.. At least insofar as the- qhoice of Catholic schools over public 
is concerned, however", the evidence fails to support at least this rationale 
for such a preference. 

We think it would be a tragic misfortune if opinion and policy ' 
regarding the public schools were predicated upon mistaken beliefs. In 
the present debate over ^blic subsidies for private schqbling, Coleman, 
Hoffer and Kilgore's study is frequently invoked as establishing the 
superiority of private sector schooling. They themselves, in fact, have 
framed their work in the context of such policy considerations. Our ' 
reanalysis"* of their data and of other data bearing on the same is^ue does 
not suppor| the conclusion that private sector schools are superior. 
Since this conclusion apparently l.s OTong, it clearly should not be invoked 
as a justification for policies to increase the role of private education 
in American society, 

20. 
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FOOTNOTES 

1. Indeeds we believe there is little basis for this conclusion 

' . • . r ■ 

even in their oim study. Our reasons for thinking this will be developed 

shortly. { ^ 

2. In response to early criticisms, Coleman and ^tiolleagues recently 

have attemp^tj^id to take account of this by comparing outcomes across 

\ 

sectors within the same Curricula, e,g,^ the academic and general tracks 
(1982a), This strategy v/as not employed in either the original technical 
(1981a) report or the commercially published version (1982b) , however, 

3. This is the reason for controlling on SES and demographic back- 
ground characteristics before comparing performance levels^ between sectors^ 

4; Evidence on these points is presented in Alexander, McPartland 
and Cook, 1980, and in Alexander, Pallas and Cook, 1981. 

5. Throughout these analyses, the HSB results reflect design 
weighting. The NLS results are unweighted. 

6. School record reports are not available in the HSB. 

7. Coleman, Hoffer and /Kilgore (1982a) also have performed such 
within-- track analyses. Controlling for track differences in this way 
presumes that track placements reflect mainly student and family preferences, 
rather than schooL policy. Althpugh both factors likely are inyolvfed^ we 
believe that curricular placements in most instances are more a function of 
student and family preferences than of school policy. Indeed, there can 

be little doubt that many families^ choose schools on thd basis of ^ their 
curriculum policies. For these reasons, we think it most appropriate that 
sector effectiveness be evaluated within nominally equivalent tracks, 
Coleman et al. have conceded that this at least is a proper concern, and 
have reported results broken down in this way. They also caution^ hox^ever. 
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that to the e^^tSnt. .tha t track placements derive exclusively from school 
policy^ tiiis sttategy will underestimate sector differences. We readily 
grant this point, jout remain of the opinion that the neglect of track 
differences al togef:ti^E^x^ould be the more serious failing. We will return 
to this issue \ater. 

The total figures reported in Table 1 pertain only to general and, 
academic track students. Coleman, Hoffer and Kilgore excluded vocational 
students because there were so few in the private sector. We have followed 
their lead in removing vocational students, from the analysis. 

8. Their stuAy, however, relied upon raw scores and used only the 
items common to th4 sophomore and senior year tests. Hencej their results 
and ours are not directly comparable. 

9. Some of these SAT scores were inputed from the ACT subtests. 
We regressed SAT verbal and mathematics performance on ACT subtests for 
the nearly^lOOO cases in the NLS with data on both sets of tests. These 
regression equations then x^ere tised to predict SAT scores for those students 
who had ACT scores but did not have SAT data* The prediction equations 
seem quite adequate 5 with multiple correlations in the .80 range ♦ 

10 • We also performed a pooled analysis neglecting curriculum 
altogether. The results of this analysis were consistent in all important 
respects with those we present in Table 2. Estimates of sector effects, 
while still subst^tntively trivial, were somewhat larger in magnitude^ 
however. The largest zero-order association of sector with an outcome 
was .127 (for the NLS test composite) ^ This might be compared with the 
largest such zero-order correlation in Table 2p .092 for general track 
students on the NLS vocabulary te^t. After regional and student background 
controls are applied, the largest standardised sector coefficient in the 
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absence of curriculum controls was .069 (for the NLS vocabulary test)* The 
largest such sector coefficient in Table 2 is ,050 (for general track 
students on the NLS vocabulary test) . As we noted earlier, we believe 
the neglect of curriculum altogether would be a serious omission; t^nce, 
,we prefer the within- track analyses presented in Table 2. Nevertheless, 
the results of the pooled analysis differ only slightly. 

11. It is arguable whether cross-sectional test scores are more 
properly used as input controls or as outcomes in research such as this. 
Coleman, Hoffer and Kilgore have opted for the latter strategy; we believe 
the case for the '^'former is stronger. 

12. We considered these data in a great many ways to assure ourselves 
that we were not missing something central to the issue of differential 
sector effectiveness. We performed parallel analyses and regression 
decompositions (siinilar to those employed by Coleman, Hoffer and Kilgore) 

0 

and have tested for various interactions in the regression framework pre- 
sented in the text. Some of these results offered up minor details that 
might be obscured in others, but all were consistent on the major question. 
The analysis we present has the virtue of being uncomplicated and is 
sufficiently faithful to detail. 

13. We should note too that Coleman, et al.'s analysis showed low SES 
and minority students to benefit most from attending private sector 
schools. Although this is not revealed in the analysis we present, the 
same pattern actually appears in both the NLS and the HS3 data. However, 

V 

alternative interpretations based on self-selection considerations could 
be advanced here as well. This is reminiscent of the ^*dif f erential 
sensitivity" hypothesis advanced in Coleman's 1966 study (Coleman, et al., 
1966^ — that the achievements of minority youth are especially affected by 
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school quality differences. In neither instance is the evidence in support 
of such substantive interpretations compelling. 

14. We should, note that x\re are more interested in the size of 
associations and of effect parameters than in levels of statistical 
significance. In most instances, the sample sizes for these analyses aje - 
so large that quite trivial relationshj.ps are significant at conventional 
alpha levels. 

15. Although we do not mean to make too much of it, we find it 
Interesting that the sector differences usually are la:^er in the NLS 
thdn in the HSB. If v/e take this pattern as reflective of selection pro- 
cesses rather than school ef f ectivenessj it might indicate that Catholic 
schools have become less selective over the intervening decade as they have ^ 
accommodated the flight from public schools, 

16. It actually is hard to tell whether Coleman^ et al.^s results 
are similar in implication, but wa^ tend to think they line up, rather well 
with ours. Since they employ raw-score test results, their descriptive 
analysis (e.g., mean number right in the various sectors) doesn't provide 
an anchor by x^hich to judge whether a difference is large or small. Their 
multivariate analysis employs a regression decomposition strategy, v/hich 
uses the results from parallel regressions across sectors. Nowhere, then, 
do we see simple associations between the sector distinctions and the 
outcomes. However , When we try to look at their data and ours in comparable 
ways, they correspond quiPte Closely, For example, based on Table, 6-2 in 
Coleman et al. (1982b), the mean differences' between the Catholic and 
public sectors, expressed as fractions of the U.S. total standard deviations, 
are .41, .26 and ,35 for the vocabulary, reading and mathematics tests, 
respectively. The corresponding number for our standard scores, .40 5 .26 
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and .33, respectively, are almost precisely the same. 

17. Recall that some of. the sample sizes here are quite small. 

18. Here too some of the samples are very small. 

19. Most research in the status attainment tradition, for example, 
uses concurrent test data as though they were predetermined relative to 
other in-school, as well as longer ternv, outcomes. In fact, a good many 
such studies employ these game NLS data in this way. 
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Table 1 



f-fean Scores on HSB and NLS Outcomes, By Sector and Within Tracks 

(N of cases in parentheses)^ 



GRAND 



SECTOR 



GENERAL TRACK 



ACADEMIC TRACK 





MEAN 


PUBLIC 


CATHOLIC 


PUBLIC 


CATHOLIC 


PUBLIC 


CATHOLI 


volab 


51 .25 


50.97 


54.29 


47.52 


, 49.68 


54.78 


55.80 


READING •■ 


51.19 


51. of ■ 


53.08 


47.74 


49.27 


54.65 


54.33 


f4AIH 


51.44 


51 .21 


53.89 


47.10 


49.18" 


55.71 


55.42 


CuWf"OSi f E 


lb4. 13 


153.45 


161 .27 


142.59 


148.09 


165.37 


165.56 




51.43 

[ I 1559; 


51.11 
(10808) 


55.53 
(851) 


46.12 
(4778) 


50.31 
(188) 


55.06 
(6030) 


57.00 
(663) 


READING 




51.26 
(10808) 


54.69 
(851) 


46.32 
(4778) 


49.02 
(188) 


55.17 
(6030) 


56.30 
(663) 




51,81 
\ 1 loby ) 


51.54 
(10808) 


55.16 
(851) 


45.60 
(4778) 


48.45 
(188) 


56.26 
(6030) 


57.06 
(663) 


CO?#OSITE 


154. 75 
( i 1 ob9) 


153.91 

(10808) 


165.38 
(851) 


138.04 
(4778) 


147.78 

(188) 


166.49 
(6030) 


170.37 
(663) 


SAT VERB 


441.69 
(8159) 


440.07 
(7382) 


457.08 
(777) 


367.43 
(1469) 


•367.31 
(112) 


458.12 
(5913) 


472.20 
(665) 


SATMATh' 


474.20 
(8140) 


474.29 
(7364) 


473.38 
(776) 


393.84 
(1464) 


386.61 
(112) 


494.25 
(5900) 


488. 01 
(664) 


VERB 79 


9.97 ■ 

(1962) 


9.86 
(1834) 


11.52 
(128) 


8.06 

(890) 


9.30 
(23) 


11.56 
(944) 


12.00 

(105) 




14.60 
(1952) 


14.49 
(1834) 


16.11 
(128) 


11.48 

(890) 


11.87 

(23) 


17.33 

(944) 


17.04 
(105) 


EOATT 


14.19 
(12766) 


14.16 
(11864) 


14.59 

(902) 


13.15 
(5143) 


13.30 
(199) 


14.93 
(674) 


14.95 
(703) 



^felqhted N's for the HSB outcomes, which represent roughly 3,000,000 cases, are not presented. 
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TablG 2 



Sector Duirmy Variable Regression Coefficients for HSB m6 
NLS Outcomes p Separately by Track and with Various Outcomes 



GENERAL TRACK 



ACADEMIC TRACK 



HSB 


PUBPRIV 
(1) 


NEAST 

NC 
SOUTH 
(COMMUN) 
(2) 


SESRAW 
BLACK 
HISlPANIC 
SEX 
(3) 


TEST72 


PUBPRIV 
(1) 


NEAST 

NC • 
SOUTH 
(COr^MUN) 
(2) 


SESRAW 
BLACK 
HISPANIC 
SEX 
(3) 


unrAD 
vULAd 

r2 


1 . OD/^ 

(-043) 
.002 


1 . 0/0 

(.032) 
.019 


(.022) 
.111 




. OO 1 

"(.030) 
.001 


384* 
(.'013) 
.021 


.079* 
(!003) 
.142 


READING 
r2 


1.148* 
(.025) 
.001 


.789^ 
(.017) 
.010 


.347* 
(.008) 
.099 




-.547* 
(-.021) 
.000 


-.835* 
(-.031) 
.010 


-1 .070^ 
(-.040) 
.116 


mTH 


1.893* 
(.043) 
.002 


1.153* 
(.026) 
.024 


.811* / 
(.018) 
.137 J 




-.444* 
(-.017) 
.000 


-.834* 
(-.032) 
.018 


-1 .022* 
(-.039) 
.180 


COMPOSITE 

R^ 


4. 908* 
(.043) 
.002 


3.317* 
(.029) . 
.023 


2.k5o* 

(/019) 
.156 




-.130 
(-.002) 
.000 


-1 .286* 
(-.018) 
.021 


-2. 01 3* 
(-.029) 
.188 


NLS 
















VOCAB 
r2 


4.211* 
(.092) 
.008 


3.479* 
(.076) 
.025 


2.306* 
(.050) 
.150 




1.971* 
(.063) 
.004 


1.595* 
(.051) 
.022 


1.231* 
(.040) 
.165 


READING 
r2 


2.678* 
(.055) 
.003 


2.245* 
(.046) 
.010 


1.034* 
(.021) 
.132 




1.141* 
(.040) 
.002 


1.142* 
(.040) 
.008 


.784* 
(.028) 
.117 


MATH 

r2 


2.862* 
(.063) 
.004 


2.255* 
(.049) 
.016 


.894 
(.020) 
.178 




.826* 
(.030) 
.001 


.834* 
(.031) 
, .011 


.187 
(.007) 
.176 


COMPOSITE 
r2 


9.750* 
(.083) 
.007 


7.979* 
(.068) 
.020 


4.233* 
(.036) 
.205 




3.937* 
(.054) 
.003 


3.571* 
(.049) 
.015 


2.201* 
(.030) 

.too 


satverb 


-2.679 
(-.008) 
.000 


-5.831 
(-.017) 
.015 


-13.126 
(-.038) 
.197 




14.155* 
(.043) 
.002 


12.457* 
(.037) 
.014 


9.587* 
(.029) 
.134 


SATmTK 


-8.887 
(-.026) 
.001 


-12.254 
(-.036) 
.017 


-21.121* 
(-.062) 
.187 




-6.176 
(-.018) 
.000 


-8.513 
(-.025) 
.010 


-14.076* 
(-.041) 
.154 


VERB79 

r2 


1.240 

(.054) 

'.003 


.941 
(.041) 
.056 


.308 
•(.013) 
.192 


-.241 
(-.010) 
.563 


.429 
(.043) 
.002 


.251 
(.025) 
.024 


.150 
(.015) 
.152 


MATH79 

r2 


.419 
(.013) 
.000 


-.043 
(-.001) 
.024 


-1.249 
(-.038) 
.190 


-1 .910" 
(-.058) 
.461 


-.305 
(-.018) 
.000 


-.322 
(-.019) 
.011 


-.755 
(-.044) 
.194 


EDATT 

r2 


.195 
(.027) 
.001 


.251* 
(.035) 
.012 


.108 
(.015) 
.099 


.023 
(.003) 
.179 


.023 
(.002) 
.000 


-.032 
(-.006) 
.005 


-.013 
(-.002) 
.103 



TEST72 



.020 
(.002) 
.526 

-.953* 
(-.055) 
.485 

-.060 

f-.on) 

.175 
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Appendix 

Independent Variables Used In Regression Analyses 



Variable 

School 
sector 

Region 



Community 
size 

SES 



Race/ 
ethnicity 



Sex 



Variable 
Name 

PUBPRIV 



NEAST 
NC 

SOUTH 



COMMUN 



SESRAW 



BLACK 
HISPANIC 



SEX 



Codes and Sources 

Coded 1 if Catholic; 0 if public. 
(NLS Var# 004; HSB student item 2) 

Coded 1 if Northeast; 0 otherwise. 
Coded 1 if North Central; 0 otherwise. 
Coded 1 if South; 0 otherwise. 
(West is omitted categ&ry) 
(NLS Var# 1066; HSB stu'dent item 6) 

Coded l=small; 2=medium; 3=large; 4=very large 
(NLS Var# 1067; No HSB counterpart) 

An equally weighted linear composite of 
standardized measures of father's educatiqn, 
mother's education, father's occupation, 
family income and household items. 

(NLS Var# 1071; HSB student item 511) 

Coded 1 if black; 0 otherwise. 

Coded 1 if Hispanic; 0 otherwise. ■ 

(NLS Var #1625; HSB student items 416 and 417) 

Coded 1 if female; 0 if male. 

(NLS Var# 1626; HSB student item 404) 
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